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ABSTRAOT 

A  nethod  is  proposed  to  simplify  the  eigenvalue  problem 
for  matrices  whose  elements  are  matrices.  The  method  is  useful  in 
cases  where  the  original  matrix  has  a  group  of  symmetries.  Appli- 
cations of  the  method  to  wave  guide  functions,  the  excluded  volume 
effect  in  polymers,  the  Ising  model  of  ferromagnetlsm  and  to  numerical 
analysis  are  given. 
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1.  Introdtictlon 

The  theory  of  wave  guide  Junctions  and  of  directional  couplere  in 
particular  employs  matrices  to  represent  scattering  operators  and  eyinmetry 
operators.  In  the  application  of  this  theory  it  is  necessary  to  find  the 
eigenvalues  of  fourth,  sixth,  and,  potentially,  even  higher  order  matrices. 
Because  these  matrices  generally  possess  some  special  symmetry  properties  it 
should  "be  possihle  to  simplify  the  computation  of  such  eigenvalues.  An  in- 
vestigation was  nade  of  the  problem  of  calculating  the  eigenvalues  of  cer- 
tain compound  matrices  which  are  descrihed  more  fully  "below.  The  theory  of 
this  paper  includes  those  cases  encountered  In  wave  guide  practice  and  makes 
fea8i"ble  more  complex  applications  than  have  hitherto  "been  attempted,  as,  for 
example,  a  junction  of  Junctions.  Several  other  applications  of  the  theory 
are  also  presented. 

This  paper  discusses  the  eigenvalues  of  nr-rowed  square  matrices 
which  can  be  written  as  r-rofwed  square  matrices  with  elements  which  are  n- 
rowed  square  matrices.  Of  course,  every  nr-rowed  square  matrices  can  "be 
written  in  this  way  and  in  general  nothing  can  "be  said  a"bout  the  eigenvalues. 
If,  however,  the  r-rowed  matrix  possesses  some  kind  of  symmetry  (in  a  sense  to 
be  made  precise  later)  we  obtain  results  which  show  that  the  eigenvalues  of 
the  original  matrix  can  be  expressed  in  terms  of  eigenvalues  of  the  n-rowed 
matrix  elements.  The  simplest  example  of  such  a  result  is  the  following: 

Let  A  and  B  be  n-rowed  square  matrices  and  consider  the  following 
2n-rowed  matrix: 


CD 


The  eigenvalues  of  this  matrix  are  the  same  as  the  eigenvalues  of  the  two  n- 

th 
rowed  matrices,  A  +  B  and  A  -  B.  This  means  that  instead  of  solving  a  2n  - 

th 
degree  determinantal  equation  we  need  solve  two  n  -degree  equations. 

The  results  we  obtain  are  based  on  the  notion  of  the  direct  product 

of  two  matrices  [l]  .   In  Section  2,  this  notion  is  explained  and  we  use  it 

to  prove  Theorems  I  and  II  which  show  how  the  sum  of  direct  products  of 

matrices  can  be  simplified.  These  results  generslize  theorems  of  D.  Z. 

Rutherford  [2]  and  of  Burns  ide  [3]  . 
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In  Section  3  we  consider  matrices  such  that  each  row  is  obtained 
from  the  preceding  "by  a  cyclic  permutation  in  which  the  elements  (n-rowed 
matrices)  are  moved  p-p laces  to  the  right.  We  show  how  the  eigenvalue 
problem  for  such  a  matrix  can  be  red-uced  to  the  consideration  of  the  eigen- 
value problem  for  sub-matrices.  The  number  and  the  degree  of  the  matrices 
will  depend  on  the  coset  decomposition  of  the  multiplicative  semi-group  of  in- 
tegers (mod  r)  with  respect  to  the  cyclic  group  generated  by  p. 

In  Section  k   three  applications  of  the  theorems  to  matrices  which 
occur  in  physical  problems  are  discussed.  These  applications  are  taken  from 
the  theory  of  directional  coT5>ler8  of  wave  guides  \hj  ,  [8] ,  the  theory  of  over- 
lapping polymer  chains  [5]  and  the  Ising  model  of  ferromagnetic  materials  [^ . 

Section  5  is  am  application  to  numerical  analysis.  Van  Neumann 
and  Goldstone  [t]  have  defined  the  "condition"  of  a  matrix,  which  is  a  measure 
of  how  well  it  is  adapted  for  numerical  computation.  We  show  that  the  condition 
of  the  matrix  for  a  finite  difference  approximation  to  the  laplacean  in  n- 
dimensions  equals  the  condition  of  the  same  finite  difference  approximation 
to  the  ordinary  second  derivative  in  one  dimension. 
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2.  The  Direct  Product  of  Matrices. 

Consider  two  linear  spaces  S  and  S  of  dimensions  n  and  r  respect- 

n      r 

Ively.  l«t  ^  be  an  arbitrary  vector  In  S  with  components  ^- ,  ^„,,,,  ^ 

and  let  >^"be  an  arbitrary  vector  in  S  with  components  vj.,  n  ,.,y^  .  The 

direct  product  of  ^  and  ^  is  defined  to  be  the  vector  C  with  nr  components 

t^  ^    ^Ai  -   lt2,..  .n;   j  =  l,2,...r).  We  write  C  =  ^  x  r[.     The  linear  space 

spanned  by  all  possible  vectors  C  is  called  the  direct  product  of  the  spaces 

S  and  S_.   It  is  written  S  x  S  and  is  obviotisly  of  dimension  nr. 
n      r  n    r 

Suppose  A  is  an  n-dimensional  matrix  with  elements  a.,,  acting  on 

the  vectors  ^  and  suppose  B  is  an  r-dioensional  matrix  with  elements  b.,. 

acting  on  the  vectors  *\  ;   then  the  direct  product  [ij  of  A  and  B  (written  AxB) 

is  the  transformation  C  in  nr  dimensions  which  transforms  the  vectors  {  as 

follows: 

If  the  nr  components  of  {  are  ordered  in  some  way,  then  C  will  be 
represented  by  a  matrix.  To  different  orderings  of  the  components  will  corres- 
pond different  matrices.  Tor  example,  put 

«k  =  <i  ^i 

where 

a)  k  =  (i-l)r  +  i 

or 

b)  k  =  i  +  (J-I)n. 

Note  that  any  other  relation  which  nsslgns  a  unique  number  k,  (l^cOir)  to  the 

pair  of  numbers  1,  J,  (1<  1  <n,  l<J<r)  can  be  used.  The  matrix  C  has  elements 

c,  ,,  where 
k'k 

^2^  °k'k=*i'i^jtj  • 

Here  k'  bears  the  same  reletion  to  the  pair  (i',J*)  that  k  bears  to  the  pair 

(i.j). 

If  relation  a)  is  used,  then  C  is  represented  by  the  following  matrix: 


(3) 


a^^B 

*12^      ... 

^in^ 

-21^ 

*22^      ... 

*2n^ 

1 

1 

1 

1 

1 

1 

a     B 
nl 

n2 

a     B 
nn 
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However,    if  relation  "b)   is  tised,    then  C  is  represented  by  the  following: 


^1^ 

\/    ■■ 

•       ^in^ 

^21^ 

'zz*     •• 

-       V^ 

1 

1 

'. 

1 

t 

1 

w 


h  -A      b  Ji.        b  Ai 
nl        nz  nn 

Even  tho-ugh  (3)  and  (^')  are  not  the  same  matrices,  they  represent 
the  same  transformation  hut  referred  to  different  sets  of  coordinate  axes. 

From  the  definition  of  direct  product  and  from  (2)  it  is  easy  to 
Bee  that  the  direct  product  of  natricee  obeys  the  following  rules  [ij : 

1)  (Aj^  +  Ag)  X  B  =  A^  X  B  +  A^  X  B 

where  the  addition   is   the  ordinary  neitrix  addition; 

2)  (A^  X  B^)    •    (A^  X  B2)   =    (A^    •   A^)  X    (B^^  •   B^) 

where   the  multiplication  Is   the  ordinary  matrix  multiplication. 

Suppose  that  X.  is  an  eigenvalue  of  A  and  \x  an  elgenralue  of  B, 
then  it  is  well  known   [l]    that  X-p,  is  an  eigenvalue  of  A  x  B;   for,   let    ^  . 
be   the  eigenvector  of  A  corresponding  to   the  eigenvalue  X.  and  let  >j.  be  the 
eigenvector  of  B  corresponding  to   the  eigenvalue  |a,    then   C  =  ^^  ^j   ifl  an 
eigenvector  of  A  x  B  since 

(A  X  B)t  =  H    ra,.,bj,j  ^^  y|j  =  E^.i^i  T  ^y.  ^j  =  ^<i.^^  ^j . 

A  useful  generalization  of  this  result  is  given  by 
Theorem  I.   Let  A^ ,  Ap,...,A  be  n-dimenslonal  square  matrices  and  B^,B2...,B 
be  r-dimenslonel  square  matrices.   Suppose  that  B, ,B„,...B  have  a  common 
eigenvector,  "ry  ,  and  that  the  corresponding  eigenvalues  are  p,. ,  p.  ,  ...p,  re- 
spectively;  then  the  eigenvalues  of 

(5)  u-^A.^   +  \J-^2  ■•■•••■•■  M'pAp 
will  be  eigenvalues  of 

(6)  C  =  A,  X  B,  +  A-  X  B_  +  . . .  +  A  X  B 

112     2  P     P 

Proof: 

Let  c,  be  an  eigenvector  of  (5)  corresponding  to  the  eigenvalue  A 
so  that 


-  5  - 


(7)  ^A^  +  ^J^/2  *  •••  *  Vp^  ^  =  '^^  • 

From  the  definition  of  >\  ,  we  hare 

then  "by   (7)   it  follows   that 

(A^xB^  +...+ApiBp)<  xy\=    (A^<)  X  (B^r,)  +   ...   +    (A^^  )  x   (B^^) 

=    (A^O  X  ^  r^)  +   ...  +    (Apd;)  X   (p-^n) 

=  (^^A^<  +  . . .  ^pAp<*: )  x>\=  X  .^  X  ^  . 

This  shows  that  ^  x  y)  is  an  eigenvector  of  (6)  correspondine  to  the  eigenvalue  X. 

It  is  well  known  [l]  that  a  set  of  comaniting  matrices  have  a  common 
eigenvector.  This  suggests  the  following 

Corollary  1.   If  the  matrices  B^,  Bg,  ...  B  all  commute,  then  the  conclusions 
of  Theorem  1  hold. 

A  simple  consequence  of  this  corollary  is 
Corollary  2.   Let  I  "be  the  unit  natrix  in  n  dimensional  space  and  I^  the  xinit 
n»trix  in  r  dimensional  space,  then  the  eigenvalues  of 


A  X  I  +  I^  X  B 
r    n 


are.  X  +  u,.  where  X^  is  any  eigenvalue  of  A  and  m-.  is  any  eigenvalue  of  B. 
•  i    j        i  J 

Corollary  2  is  identical  with  a  theorem  given  by  D.E.  Rutherford  on  page  21 

of  reference  |2|.    we  shall  illustrate  Theorem  I  hy  considering  the  following 
matrix; 


^3 


(8)  C     =     /     A^       A^       Ag 

^1 
where  A   ,  A   ,  A-  are  n-dimensional  sqtip.re  matrices.     We  may  write 

X  C  ^ 

C  =  A^  X  B^  +  A^  X  B^  +  A3  X  B3 

where 

/l     0     0  \  /^     ^     °  \ 

B. 


B^     =     I  0     1     0    j      .     B2  =   ^   u     u     X     j  .        ^3 
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?  2 

Since  B^  =  B^ ,  the  identity  matrix,  the  eigenvalues  of  B-  are  1,  p,  p 

where  p  is  a  cube  root  of  unity.  Let  >\  »  *Vti  ^  ^®  ^^^   eigenvectors  of  B- 

corresponding  to  the  eigenvalues  1,  p,  p  respectively,  then  since  B_  =  B^,  we 

have 

80  that   Vy^  ,   l\- ,   >\-  are  eigenvectors  for  all  three  matrices  B,,  B_,  and  B-. 
From  Theorem  I  we  conclude  that  the  eigenvalues  of  C  a  matrix  of  3^  dimensions 
will  he  given  hy  eigenvalues  of  the  three  n-dimensional  matrices: 

A^  +  Ag  +  Ay         A^  +  PA2  +  P^A^,    A^   +  ph^  +  pA^ 

Theorem  I  may  he  generalized  to  cases  where  B^,  B^,  *..,  B  may  not  have 
a  common  eigenvector.  Consider  the  ring,  B,  generated  hy  the  matrices  B^,  B-,...,B 
under  niatrix  addition  and  miiltiplicstion.  The  ring,  R,  considered  as  an  ahstract 
ring,  has  an  r-dimensional  rei^resentation  given  by  the  matrices  B^ ,  B  ,  ,..,  B  and 
the  matricps  generated  from  them.   If  this  r-dimensional  representation  is  irred- 
ucible, nothing  can  he  said  about  C.  On  the  other  hand,  if  the  r-dimensional 
representation  is  reducible,  it  can  be  written  as  the  direct  STim  of  irreducible 
representations.  Every  such  representation  of  degree  one  implies  that  the  matrices 
B- ,  B-,  ...,  B  have  a  common  eigenvector.  A  representation  of  degree  m  implies 
that  there  exists  an  m-dlmensionnl  subspace  which  is  invariant  under  the  trans- 
formations of  the  ring  R.  Let  v^  ^   ,  >^  ^   ,  ...,  •\  i""  t  J  =  It  ...i  r,  be  the  com- 


(k) 
ponent;s  of  a  basis  for  this  subspace;  , then,  if  ^i|4»  ^  =  1»  •••iPlJiJ'  =  1»  "-*''^t 

,   we  have 
(k)  ,  (h«) 


are  the  elements  of  a  matrix  B  ,  we  have 


h—  1,  2,  •••#  B 


(k) 
so  that  J\t-L   ^'^^  ^^^  elements  of  a  matrix,  M.  ,  which  represents  B.  , 

We  now  state 
Theorem  II.  Let  C  be  the  matrix  considered  in  Theorem  I.  S-uppose  that  the  riog 
generated  by  the  matrices  B^ ,  ...  B  has  an  m-dimensional  representation  (m<r)  in 
which  the  matrix  B  is  represented  by  M,  ;  then  every   eigenvalue  of  the  nm  dimen- 
sional matrix 

D=A,  XM-+...+A  xM_ 
IT.         P    P 

is  an  eigenvalue  of  the  nr-dimensional  matrix 

C  =  A^  X  B^  +   . . .  +  A     X  B 


-  7  - 
Proof: 


(ic) 
Let  *j  |ji  1  =  If  2,  ...,  n,  be  the  elemente  of  the  matrix  A.  and  suppose 

?  j^j^t  i  =  It  2,...,  n;  h  =  1,  2,  ...,  m,  is  an  eigenvector  of  the  matrix  D  so  that 


(k)  _(k) 
I'h 

(h) 


(10)  rilZIal^X^i     ^ih=^5i.h.  • 


We  show  now  that  £1  5  i^  ^  1       i"  *Q  eigenvector  of  C;  for,  uilng   (9)  and   (10), 
we  have 

^J-5ih^j        L.L_L.^,ii>j,j  1>  5ih    nj 

kji       iii^i^,     aa       J 
h«       •^         kJi       1^^^ 


Ih 


h« 

This  also  ahowe  that  X  is  an  eigenvalue  of  C  and  so  completes  the  proof. 

3.  Permutation  Matrices, 

Theorem  n  can  be  used  to  analyze  permutation  matrices  which  are  of  the 
same  type  as  (8).  A  matrix  will  he  called  a  permutation  natrix  if  the  elements  of 

any  row  are  a  permutation  of  the  elements  of  the  first  row.  Let  A,,  A^,  ...,  A  be 

12        r 

the  elements  of  the  first  row  of  a  permutation  matrix  5  •  l*t  the  elements  of  the 
second  row  be  the  elements  of  the  first  row  shifted  cyclically  p  places  to  the 
right  80  that  the  elements  of  the  second  row  are  A  .^.-it  A    -,...A  ,  A^ ,  A_,.,.A 
in  that  order.  Let  the  elements  of  the  third  row  be  the  elements  of  the  first  row 
shifted  2p  places  to  the  right  and  in  general  let  the  elements  of  the  kth  row  be 
the  elements  of  the  first  row  shifted  (k-1)  places  to  the  right.  Such  a  matrix  will 
be  called  a  p-cycle  permutation  matrix.  '►lote  that  (8)  la  a  one-cycle  permutation 
matrix. 

Suppose  C  is  a  p-cycle  permutation  matrix;  then  it  is  easy  to  see  that 

(11)      C  =  A^  X  B^  +  A^  X  Bg  +  ...  +  A^  X  B^ 
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where  B, ,  B-,    ....  B     are  r-dimensional  matrices,  all  of  whose  elements  are  zeros 

12  r 

except  for  one  element  in  each  row  which  is  ■unity.      If  p  is  prime  to  r,   there  will 

he  just  one  unity  in  every  row  and  coluBin  so  that   the  matrix  B.    will  he  non-singular 

In  this   case  the  matrices  B, ,    ,..,  B     generate  a  group,  G,  and  hy  Theorem  II  the 

J.       r 

irreducible  representations  of  G  can  he  used  to  simplify  the  matrix  C. 

The  irreducible  representations  of  G  will  depend  on  the  r-th  roots  of 
unity  and  the  number-theoretic  properties  of  p,  modiilo  r.  Hereafter,  we  assume  that 
p  is  prime  to  r.  Let  t  be  the  exponent  to  which  p  belongs  modulo  r,  that  is,  t  is 
the  smallest  positive  integer  such  that 


(12) 


p  s  1  (mod  r); 


then  the  multiplicative  seml-rroup  of  intefers',  1,2, ...r-1,  modulo  r.  can  be 

2       t— 1 

written  as  a  sum  of  cosets  relative  to  the  cyclic  group  1,  Pt  p  ,  ...t  P   . 

In  other  words,  the  set  of  integers  1,  2,  ....  r-1,  modulo  r  can  be  written  as 


t-1 


If  P,  P^.  ...f  P   i  a^.  a^P*  a^p  ,  ....  a^p  "  ;  a^,  a^p,  . 


t-1 
,  a-p   ;  and  so  on, 


where  a.  is  any  integer,  not  divisible  by  r,  which  is  not  in  the  set  1,  p,  ....  p 
a  is  any  integer  not  divisible  by  r,  which  is  not  in  either  of  the  sets  1,  p,...,p 
or  a-,  a-p,  ,..,  a  p*~^,  and  so  on.  Let  p  he  a  primitive  r-th  root  of  unity  and 
define 


(13) 


^k  "  A^+P%+P^'^3+«"-^P^  '■^\'    k  £  0.  1,  2 r-1, (mod  ^\ 


then  we  shall  prove  the  following: 

Theorem  III.  Let  C  he  a  p-cycle  permutation  matrix;  then  the  eigenvalues  of  any 

of  the  following  matrices; 

(1^) 


0      0 


t-2 


3t-l 


^nP^ 


,t-2 


S   t-1 
a^p^  -L 


\ 


t  ••• 
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will  be  eigenvalues  of  C. 

As  was  remarked  before,  (8)  is  an  example  of  a  one-cycle  permutation 

matrix,   Obvioiasly  t  =  1  and  then  by  Theorem  III,  the  eigenvalues  of  S  ,  or  S,  , 

0      1 

or  S„  will  be  eigenvalues  of  (8),  This  agrees  with  our  previous  result. 

For  another  illustration,  consider  a  minus-one  cycle  permutation  matrix 
with  r  =  6.   By  a  minus-one-cycle  matrix  is  meant  a  matrix  where  the  elements  of 
each  row  are  the  elements  of  the  preceding  row  moved  cyclically  one  place  to  the 
left.   Let  p  be  a  primitive  sixth  root  of  unity  and  let  S.  be  defined  by  (13), 
Note  that  3  ,  =  S^.  and  that  t  =  2i  then  from  Theorem  III  the  eigenvalues  of 

will  be  eigenvalues  of  the  original  matrix. 
Proof: 

In  the  proof  of  Theorem  III  we  shall  not  try  to  find  the  irreducible 
representations  of  S.   Instead,  we  shall  find  a  matrix  U  which  transforms  the 
original  representation  of  Q   into  a  direct  sum  of  irreducible  representations. 

Let  the  elements  of  C  be  written  as  A . .  where 

(15)  A^j  =  •*'l(r-p)+J+l'      ^'^  -  0.1.2... -.r-l.Cood  r). 

Suppose  that  the  integers  1,  2,  ...,  r-1  are  written  as  the  sum  of  the  cosets; 

(16)  l.PfP  I  ...I  P   f  *■!  .*iP» ..  •  i*-iP   »  *2'^2^*  •• '^Z^   •  ^^^   *°  ^^* 

Let  <\..\_k  =1,   2,    ...,   r-l,(mod  r|jbe  the  kth  integer  in  the  sequence   (16)  and  let 

a    5  0    (mod  r). 

Define  a  matrix  U  w'ith  elements  u..  as  follows;  u..  is  I   (the  identity  matrix  in 

n  dimensions)  times  p  to  the  exponent  ja^,  where  j,k=0,l, . . . ,r-l, (mod  r\      Let  ?  be  a 
matrix  with  elements  v.,  where 

Since  p  ie  a  primitive  rth  root  of  unity, 
r-l 

H 

J=0 
unless  a  «  0  (mod  r)  in  which  case  the  sum  is  r.  Now,  by  (1?)  and  (18), 


(18)  y-    p°J  =  0 


-  10  - 

vu  =  ( r  v^jUj^)  =  ( E  ^]i^jk) 

(ou -a  )J 
=  (I^Ep       )  =  (r«ij^I^).  i.kH  O,l,...,r-l,(mod  r)  , 

which  is  r  times  the  identity  matrix  in  nr-dimensional  space.  We  see  thea  that 
The  eigenvalues  of  C  will  be  the  same  as  those  of  the  similar  aiatrix 


C^  -  (r'^''^)"^C(r"^^^)  =  r"Hca. 


The  elements  of  C,  are 

(19)        .-^EE^ja^.v'fElp-^'^Sp'^ 

where  "by  (15) 

(20)      p  =  J(r-p)  +  k  +  1. 

For  fixed  J,  P  runs  over  a  complete  residue  sjrstem  mod  r  as  k  varies; 
hence,  summing  over  3  instead  of  k,  we  find  that  the  sun  in  (19)  becomes 

i  ^    ^ 

=  5-pJ(pah-°i)s 

from  (13),  Again,  by  (18)  this  sum  is  zero  unless 

c-j  5  pa  (mod  r)  . 

We  see  theji  that  the  elements  of  C^  are 


(21) 


and  from  this  representation  the  conclusion  of  Theorem  III  follows. 

If  A, ,  A_,  . , . ,  A  are  not  matrices  but  ordinary  scalars 
12       r 

eigenvalues  of  C  can  be  found  Immediately.  We  state  the  following 
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Corollary.  Let  C  "be  a  p-cycle  permutation  matrix  and  let  the  elements 

A-,  ,..,  A  be  acalars;  then  the  S  are  scalarB  and  the.  eigenvalues  of  C  are 


S  ,  the  t-th  roots  of 
o* 

S.  S  So  « • .  s 

1  p  p'     J 

the  t-th  roots  of 


t-1  • 


S   S 
a 


•1-  ***  V*'^  • 

and  so  on. 

This  corollary  Includes  some  well  known  results  in  determinants  r3l , 
k.     Applications. 

To  indicate  the  application  of  the  above  theory  to  wave  guide  Junctions 
we  consider  the  matrix 


■(::) 


which  appears  in  the  theory  of  directional  couplers  (see  page  ^37  reference  [U]  ), 
To  obtain  the  eigenvelues  of  this  matrix  we  apply  Theorem  III  and  conclude  first  that 
the  eigenvalues  of  S  are  the  eigenvalues  of 


A  +  B  = 


^a  -f  Y   P  +  6 
1-6   a  +  V, 


and  A  -  B  = 


a  -  Y 

.P  -  6 


P  -  6\ 
a-  Y  /   • 


We  may  now  apply  the  theorem  again  to  assert  that  the  eigenvalues  of  S  are  the  eigen- 
values of  the  one-element  matrices 


(  a.  +  Y  +  p  +  6),  T, 


(a+Y-P-6),  T^=  (a-Y+p-  6)  ,T^=(a^Y-p+6  ). 


Of  course  the  eigenva-lue  of  each  T.  is  the  element  itself. 

This  result  should  be  compared  with  formula  (129)  on  p.  ^^H  of  reference  [h\ , 

In  a  recent  paper  on  overlapping  polymer  chains  [5]  the  eigenvalues  of  the 
following  matrix  had  to  be  found: 


(23) 


A, 


A« 


'1/ 


This  matrix  it  will  be  noted  has  the  same  structure  as  that  Just  considered  but 

here  the  elements  A  are  matrices  instead  of  scalars.  From  the  nature  of  the  problem 


-  12  - 


it  was  evident  that  there  existed  a  symmetry  group,  namely:  the  ^roup  of  reflec- 
tions ahout  the  x  or  y-axis.  Since  this  group  is  commutative,  all  its  irreducible 
representations  are  one-dimensional  ana  thus  "by  Theorem  I  or  II,  the  eigenvalues 
of  (23)  are  the  eigenvalues  of  A^+Ag+A.+A^,  or  A^^-Ag+A.-A^,  or  A^+A^-A^-Aj^,  or 


^l"'^2"^3*'^i+' 


In  a  paper  on  the  Ising  model  for  ferromagnetic  materials  \5j   the  eigen- 
values of  the  product  of  the  following  two  matrices  had  to  be  found: 


1 


cos  d» 


-sin  «i 


(24) 


B 


\ 


B 


W 


B 


sin  d'  Cos  e 

Here  A  and  B  are  two-dimensional  rotation  matrices,  as  follows: 


■J 


B 


(cos  e*    sin  «•  I 
-sin  0"   cos  9* J 


The  first  matrix  of  (2^)  can  obviously  be  written  as  A  x  I  where  I  is  the  identJ 

'  n       n 

matrix  in  n-dimensions.  The  second  matrix  of  {Zh)   is  not  a  direct  product  but  it 

can  be  seen  to  be  a  sum  of  direct  products  if  it  is  written  as  follows: 

cos  e*  0       0       0  0       -sin  ©• 

0      cos  6'   sin  ©'  0  0       0 

0     -sin  ©•   cos  0»  0 

0       0       0       cos  e' 


i 


0       0 

sin  9"  0 
which  can  be  written  as 


cos  e' 

0 

0 

0 

0 

cos  ©• 

sin  «• 

0 

0 

-sin  0« 

cos  e' 

0 

0 

0 

0 

cos  ©• 

(25) 


A.-  X  I  +  A, 
c    n 


L-  X  J  +  A,,  X 
3    n    4 


K 


I 


A,  / 
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where 


(26) 


(27) 


COB  e' 

0 


/c 


0  1 


•    •    •    • 

0  1.. 


\ 


1  0 

.    1 


V 


V 


1  0, 


The  product  of  the  matrices  ie 
by  the  rulee  for  operating  with  direct  products.   It  is  easy  to  show  that 


n      n 


.  j!=i 


80  that  I  ,  J'  and  K  all  have  a  common  eigenvector.   If  p  is  a  primitive  nth  root 

n   n      n  k   -k 

of  unity,  then  the  eigenvalues  of  I  ,  J  ,  I  are  1,  p  ,  p  (k  =  0,  1,  ,,.,  n-1) 

n   n   n 

respectively.  From  Theorem  I  we  conclude  that  the  eigenvalues  of  the  n  two-dimen- 
sional  matrices 

(28)      AAg  +  P^AA^  +  P"^AA^  ,  k  =  0,  1,  ,, . ,  n-1 

will  "be  eigenvalues  of  the  original  product.  This  agrees  with  the  results. 

5.   Condition  of  a  Matrix. 

The  usefulness  for  computational  purposes  of  a  finite  difference 
approximation  to  a   partial  differential  equation  depends  on  the  matrix  of  the 
finite  difference  equations.   One  test  of  whether  a  matrix  is  "well-conditioned" 
for  comiiut&tional  purposes  depends  on  the  size  of  its  P-condition  numher,  which 
has  "been  defined  as  the  ratio  of  the  greatest  to  the  least  (in  absolute  value) 
characteristic  root  of  the  matrix  [t] . 
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We  consider  the  following  partial  differential  equation: 

(29)         a-s_  +   a5i_  ^   afa_  =  xu 

bx^  dx-      ^*o 

within  a  cube,  of  side  h,  on  the  'bonndary  of  which  u  vanishes.  Divide  the  cube, 

•a 
which  has  vertices  at  (O,  0,  0)  and  (h,h,  h),  into  (n+l)  cubes  each  of  side  h  by 

the  lines  x.  =  rh.^  x  »  eh,  x«  =  th,  where  r,  s,  t,  =  1,  2,  ...,  n.  Suppose 

that  the  second  derivrtive  in  any  direction  is  replaced  by  some  finite  difference 

approximation  involvlr^  only  points  on  a  line  parallel  to  the  direction  of  differ- 

entation.  For  example,  if  we  put 


tij.  g  ^  =  u(rh,8h,tb). 


a  possible  approximation  to  s  would  be 

9x. 


C  Vl,  8,  t  -  ^r.  a.  t  *  ^r-l,  s.  t  )  ^"*  • 


In  general  the  finite  difference  approximation  can  be  represented  by  the  action  of 
some  matrix  M  on  the  coordinetes  along  the  line  of  differentation.   If  we  write  I 
for  the  n  X  n  unit  matrix,  we  see  that  the  finite  difference  approximation  to  (29) 
is 

(30)    (MxIxI+IxMxI+IxIxM)u      .=Xh^u 

r,  s,  t       r,8,t 

Now,  by  Theorem  I,  the  eigenvalues  of  the  matrix  on  the  left  side  of  (30)  are 
A..  +  X.  +  A,  ,  i,  J,  k,  =  1,  2,  •••,  n 

where  X.,  \  ,  X^,  are  eigenvalues  of  M.  It  is  clear  that  the  P-condition  number 
of  the  matrix  in  (30)  is 

3X    /  3^.  4   =  X    /  X  , 

max  '   min     max  '   min 

where  X  is  the  maximum,  X  .   the  minimum  (in  absolute  value)  of  the  eigenvalues 

max  min  '         o 

of  M;  therefore,  the  P-condition  number  of  the  matrix  in  (30)  is  the  same  as  the 
P-condltion  number  of  M. 

This  result  can  be  obviously  generalized  to  more  dimensions.  We  have 
then  the  following! 

Theorem  IT.  Let  M  be  the  matrix  associated  with  the  finite  difference  approximation 
to  the  second  derivative.  Suppose  the  same  approximation  is  used  in  each  direction 
for  the  partial  differential  operator: 
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(31)     ^  *  ^  +  ...  *  ^  =Xu 

over  an  n-dimenelonal  cube;  then  the  P-condltion  number  of  the  matrix  associated 
with  the  approximation  to  (31)  i*   the  same  as  the  P-condition  number  of  M. 
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